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Officials  in  both  executive  and  legislative  branches  of  state  govern- 
ment need  up-to-date  knowledge  of  the  status  of  the  state  budget  as  it  progresses 
from  Governor  to  House  to  Senate  to  Conference  Committee.   Basic  information  is 
required  on  what  is  happening  in  the  1500-odd  accounts  that  make  up  the  budget. 
Especially  valuable  are  simple,  but  timely,  ad  hoc  analyses,  such  as 
changes  from  one  version  of  the  budget  to  another  and  special  subtotals  of 
accounts  by  particular  programs.   A  flexible  on-line  computer  system  written 
in  a  high-level  language  provides  these  services. 

The  system  and  its  evolution  may  be  analysed  from  the  point  of  view  of 
four  contributing  management  science  methodologies  (1)  implementation  theory, 
(2)  information  systems  technology,  (3)  models,  and  (4)  planning  and  control 
systems.   Simple  but  important  principles  from  each  aiea  are  conspicuous  in 
the  system  development. 

Although  the  system  came  into  operation  late  in  the  FY  75  budgeting  pro- 
cess, it  was  used  for  several  tasks  and  the  results  to  date  are  evaluated. 
The  costs  of  the  system  have  been  small  in  money  and  people's  time.   The  major, 
if  somewhat  intangible,  benefit  is  the  injection  of  certain  analytic  capabilit- 
ies into  the  Fiscal  Affairs  Staff  of  the  Department  of  Administration  and  Fi- 
nance (A&F) .   More  concretely,  a  knowledge  of  the  budget  numbers  and,  especially, 
changes  in  them  was  acquired  in  a  timely  fashion  by  A&F  officials,  the  Senate 
Ways  and  Means  Committee,  the  House-Senate  Conference  Committee,  and  the  press. 
Members  of  the  Fiscal  Affairs  staff  developed  a  greater  understanding  of  the 
FY75  budget  and  an  increased  ability  to  Interact  with  It.   In  addition,  the 
system  appeared  to  contribute  to  good  relations  between  A&F  and  the  legis- 
lature by  being  a  source  of  timely  information.   This,  in  part,  was  the  result 
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of  a  system- induced  change  in  process  because  budget  data  went  from  Senate 
Committee  to  A&F,  an  exe  utive  branch  department,  and  then  back  to  the 
legislature.   Finally,  the  system  probably  produced  a  small  amount  of  labor 
reduction  by  performing  certain  functions  with  less  than  human  effort.  However 
this  has  been  balanced  by  additional  tasks  performed  (just  the  tasks  that 
make  the  system  important). 


Introduction 


The  Massachusetts  budget-making  process 
is  a  shell  game.   And  over  5.7  million  Massa- 
chusetts residents  are  the  losers. 

Lack  of  information,  confusion  and  poli- 
tics wreak  havoc  on  fact-seeking  legislators 
and  citizens  alike. 

A  privileged  few  with  budgetary  knowledge 
based  on  many  years  of  experience  leaves  others 
to  make  blind  decisions.   Their  mastery  of  the 
budgetary  maze  with  its  Alice  in  Wonderland 
([ualitles  effectively  eliminates  meaningful 
participation  by  others. 


So  declares  the  Massachusetts  Taxpayers  Foundation  in  a  report  on  the 
Massachusetts  budget-making  process  [1].   The  report  goes  on  to  analyze  the 
present  system  and  nake  a  variety  of  recommendations  for  changing  it.   Some 
of  these  call  for  better  information  and  better  access  to  it.   Others  ask  for 
better  revenue  projections,  explicit  estimates  of  continuing  costs  and  the 
gradual  implementation  of  a  program  management  system.   Implicit  throughout 
and  explicitly  recommended  are  improved  financial  information  systems. 

Certain  steps  to  improve  the  budgeting  process  have  already  been  taken. 
In  August  1974  the  legislature  passed  a  budget  reform  act  [2].   The  following 
excerpt  illustrates  the  data  expectations  thereby  made  law: 


...recommendations  for  appropriations... 
submitted  by  the  governor ...  shall  be  classified 
to  show  the  request  of  each  officer  having  charge 
of  an  office,  department  or  undertaking,  includ- 
ing priorities  assigned  to  each  program  by  said 
officer,  the  recommendation  of  tlie  [relevant] 
secretary...,  the  recommendation  of  the  governor, 
the  prior  year  appropriation,  if  any,  and  shall 
indicate  the  number,  if  any,  of  permanent  posi- 
tions proposed,  ...  and  the  number  of  persons  to 
be  served  or  the  number  of  actions  to  be  taken 
by  such  officer. . . 


The  clamor  for  information  to  increase  public  accountability  and 
managerial  control  shows  through  this  wording.   To  implement  the  law  data 
will  have  to  be  collected,  collated,  analyzed  and  tabulated.   This 
implies  the  need  for  some  kind  of  computerized  information  system. 

Yet  caution  is  required.   As  much  experience  has  shown,  numbers  in 
a  computer  do  not  an  information  system  make  nor  stacks  of  printout  a  sage. 
The  best  systems  often  start  modestly  and  evolve.   Furthermore,  different 
actors  in  the  budget  process  have  different  needs  and  may  best  be  served  by 
different  means. 

Therefore,  within  a  general  goal  of  developing  aids  to  the  budgeting 
process,  we  have  defined  an  initial  task.   This  is  to  develop  an  experimental 
but  operational  and  useable  budget  preparation  and  tracking  system.   It  is 
intended  specifically  to  assist  at  least  one  group,  the  analysts  in  the 
Fiscal  Affairs  section  of  the  Executive  Office  of  Administration  and  Finance. 
However,  at  the  same  time,  it  is  hcped  and  intended  that  the  system  will  be 
helpful  to  others  and  that,  more  generally,  we  shall  learn  what  will  aid 
policy  analysis  in  state  government. 

In  this  paper  we  first  describe  the  budgeting  process  in  Massachusetts 
and  then  the  tracking  system  that  lias  been  built.   From  there  we  go  on  to 
present  four  views  of  the  system  from  the  standpoints  of  four  different  man- 
agement science  methodologies.   Finally  we  attempt  to  evaluate  the  system 
as  Lt  has  progressed  so  far. 

2.   The  Budgeting  Process  and  the  r.udget 

2.1  The  Process 

Setting  a  budget  for  the  Commonwealth  of  Miissachusetts  is  a  venr  long 
process.   The  cycle  begins  in  the  summer  when  the  Comptroller  sends  each  state 


agency  a  computer  printout  showing  its  prior  year  expenditure  and  current 
appropriation.  This  is  broken  down  by  account  and  subsidiary  account.  (An 
aci ount  is  a  line  item  in  the  budget  and  a  subsidiary  account  is  a  subdivi- 
sion thereof.)   Using  the  past  as  a  base,  the  agency  prepares  a  request  for 
the  next  fiscal  year  (starting  July  1  of  the  following  calendar  year).   The 
agency's  proposal  is  reviewed  by  the  relevant  cabinet  secretary,  and  by 
September  15,  all  budget  requests  are  supposed  to  be  submitted  to  the  Direc- 
tor of  the  Budget  Bureau,  although  in  fact  many  are  not  in  his  hands  by  this 
date.   When  the  agency  requests  are  submitted,  courti'sy  copies  are  sent  to 
the  House  and  Senate  Ways  and  Means  Committees. 

In  the  late  fall  the  requests  are  reviewed  by  Budget  Bureau  analysts 
and  by  the  Commissioner  of  Administration  (the  state's  top  fiscal  officer). 
These  reviews  verify  the  accuracy  of  the  budget  requests  and  assess  the  merits 
of  any  proposed  increases.   In  recent  years  the  reviews  have  resulted  in  cuts 
of  10-15%  from  the  requested  amounts.   The  resulting  budgets  go  to  the  Gov- 
ernor as  input  to  his  budget  recommendations. 

The  state  constitution  requires  that  the  Gov.rnor  recommend  a  budget 
to  the  General  Court  within  three  weeks  of  its  convei  ing.   The  Governor  usu- 
ally files  his  budget  message  with  the  House  Clerk  on  the  fourth  Wednesday 
in  January.   His  recommended  budget  (known  as  House  1)  is  presented  in  line 
item  appropriation  account  form  and  includes: 

-  the  prior  year's  expenditures 

-  the  current  year's  appropriation 

-  agency  budget  requests  for  next  year,  and 

-  the  Governor's  budget  recommendations  for  next  year. 


Supporting  schedules  show  account  breakdowns  to  the  subsidiary  level  and  in- 
clude personnel  counts.   The  Governor's  recommendations  automatically  go  to 
the  House  Ways  and  Means  Committee.   This  version  of  the  budget  does  not  in- 
clude recommended  capital  expenditures,  which  arrive  later  in  a  separate 
capital  budget,  nor  does  it  include  recommendations  for  new  programs,  which 
the  Governor  usually  sends  in  supplementary  budgets. 

In  the  period  from  January  until  about  April,  the  House  Ways  and  Means 
Committee  analyzes  the  recommended  budget.   This  process  frequently  includes 
closed  hearings  with  cabinet  secretaries  and  the  heads  of  spending  agencies. 
The  outcome  of  these  meetings  is  a  draft  appropriation  bill  which  the  Commit- 
tee Chairman  reports  to  the  House  in  late  April.   The  Committee's  bill  is  de- 
bated on  the  House  floor,  often  ammended,  and  eventually  (usually  in  May)  is 
passed  by  the  House. 

Once  the  House  passes  the  appropriation  bill  it  is  sent  to  the  Senate 
and  there  referred  to  the  Senate  Ways  and  Means  Committee.   While  this  com- 
mittee is  sent  a  copy  of  the  Governor's  budget  messag  •  at  the  same  time  as 
is  the  House  Committee,  the  Constitutional  requiremeni  that  all  appropriation 
bills  originate  in  the  House  prevents  the  Senate  from  doing  more  than  analyz- 
ing the  Governor's  message  until  the  House  bill  is  passed.   Once  the  House 
bill  arrives,  the  Senate  Ways  and  Means  Committee  examines  it,  makes  the 
amendments  it  wants,  and  reports  the  bill  out  to  the  full  Senate.   Because  of 
the  statutory  requirements  to  enact  an  appropriation  bill  before  the  beginning 
of  the  fiscal  year  (July  1),  the  time  spent  on  the  bill  by  the  Senate  is 
ustially  considerably  less  than  that  spent  by  the  House. 

After  the  Senate  passes  its  bill,  the  House  and  Senate  must  reconcile 
any  differences.   Normally  this  means  a  conference  committee,  composed  of  members 
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of  both  Ways  ani  Means  Committees.   After  revision  the  bill  goes  back  to 
each  house,  ami  after  both  accept  it,  the  measure  goes  to  the  Governor  for 
his  signature.   The  Governor  may  sign  the  bill,  veto  it,  veto  sjiecific  line 
items,  or  reduce  specific  line  items  through  the  "item  reduction  veto"  (sel- 
dom used,  since  the  same  result  can  be  obtained  more  flexibly  by  withholding 
funds  via  the  allotment  process).   If  the  bill  is  signed,  it  becomes  law. 
In  the  case  of  any  type  of  veto,  the  Governor  must  notify  the  House  within 
ten  days  of  his  receiving  the  budget;  a  two-thirds  vote  of  both  houses  over- 
rides the  Governor's  veto. 

To  sum  up  the  process,  after  a  full  year  of  work,  the  spending  agen- 
cies' original  budget  requests  have  passed  through  a  half  dozen  versions  and 
finally  emerged  as  the  budget  for  the  Commonwealth.    Th.  appropriation  act, 
however,  is  not  the  full  story  of  state  spendin;,.   Capital  expenditures  are 
not  included,  but  rather  appear  in  a  separate  capital  budget  that  follows  a 
process  closely  paralleling  the  one  described  above  (athough  in  miniature) . 
In  addition,  not  all  current  spending  is  included  in  the  appropriation  act. 
The  Governor  has  the  power  to  recommend  supplementary  (for  new  programs)  and 
deficiency  (for  agencies  whost  initial  funds  are  found  to  be  insufficient) 
budgets.   In  r  cent  years  both  of  these  devices  have  been  used  extensively. 

2 . 2  The  product 

The  basic  component  of  the  budget  is  the  line  item  appropriation  ac- 
count.  Each  such  account  represents  a  part  of  the  activity  of  one  spending 
agency.   Accounts  are  further  broken  down  Lnto  one  to  twenty  subsidiary 
accounts  which  r.ipresent  particular  types  of  expenditures  —  eg.,  salaries, 
travel,  office  and  administrative  expenses. 
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The  budget  is  hierarchical;  that  is,  accounts  aggregate  into  agency 
totals,  agencies  into  departments,  and  departments  into  secretariats.   Paral- 
le  Lng  the  budget  is  the  Personal  Services  Book,  which  gives  the  number  of 
positions  included  in  each  line  item  account.   Similarly,  the  capital  outlay 
budget  describes  proposed  capital  expenditures  by  account.   State  revenues 
are  grouped  into  funds  (e.g.,  the  (eneral  Fund,  the  Highway  Fund),  and  each 
account  in  House  1  shows  which  fund  or  funds  supply  its  moneys. 

The  form  and  nature  of  the  budget  document  and  the  budget  process  have 
certain  implications.   First,  only  those  people  who  spend  a  great  deal  of  their 
time  working  with  the  budget  can  truly  understand  how  the  state  is  spending 
its  money.   This  tends  to  pur.  the  average  legislator  at  a  disadvantage  rela- 
tive to  a  Ways  and  Means  Contnittee  member,  and  results  in  relatively  little 
input  from  the  floor  of  either  branch  of  the  legislature.   A  related  problem 
is  that  of  understanding  program  efficiency  and  effectiveness.   Since  the 
budget  does  not  include  any  unified  indication  of  what  programs  each  expendi- 
ture is  to  support,  it  is  difficult  to  track  the  size  of  particular  programs 
or  to  determine  their  success  in  meeting  their  goals.   The  problem  is  compounded 
by  the  practice  of  starting  with  the  current  budget  as  a  base,  and  focusing 
attention  only  on  changes  in  level  of  spending. 

3.   Computer  System  Description 

Specifications  for  the  system  are  given  in  Section  3.1  and  its  current 
state  of  realization  in  Section  3.2. 

3 . 1  Specifications 

(1)  Input  and  storage  of  various  versions  of  the  state  budget  (e.g. 
those  of  Governor,  House,  Senate  and  working  versions  of  same).  Up  to  ten 
versions  should  be  possible. 
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The  budget  is  made  up  of  about  1500  accounts.   For  each  account  the 
system  must  contain 

-  a  dollar  amount  (which  can  diff.  r  for  different  versions) 

-  an  identifying,  number 

-  a  verbal  description 

-  the  associated  Secretariat 

-  the  .'  isociated  Depai  tment 

-  one  I  r  more  associated  Funds  and  percentage  figures   for 
each  indicating  what  fraction  of  the  money  for  the  account 
comet,  from  that  Fund. 

To  give  an  exanple,  Account  2611-1300,  Maintenance-Salisbury  Beach, 
has  a  recommended  amount  for  FY1975  of  $370,665  in  the  Governor's  budget.  The 
account  is  part  of  the  Department  of  Natural  Resources  under  the  Secretary  of 
tht  Environment.  1  Affairs.   100%  of  the  money  comes  from  the  Recreation  Areas 
Fund. 

For  some  versions  of  the  budget,  subsidiary  account  data  (breakouts 
by  salaries,  supplie  ,  travel,  etc.)  may  be  required.   The  system  should  ac- 
comodate up  to  6  active  subsidiary  accounts  per  main  account. 

Other  data  to  be  stored  are  personnel  c  )unts  by  department  and  secre- 
tariat and  departmental  revenues. 

It  should  be  possible  to  input  a  budget  version  quickly.  In  a  matter 
of  a  few  hours  if  necessary.   This  neans  the  ability  to  type  the  data  in  on- 
line and  implies  prompting,  editing,  display  and  other  features  to  facilitate 
input.   In  addition  versions  of  the  Budget  that  arrive  in  machine  readable 
form  (e.g.  tape  and  cards)  should  be  installable  within  24  hours  of  receipt. 

In, ut,  especially  of  online  versions  or  small  changes,  should  not 
require  computer  skills  beyond  an  hour  or  two  of  training.   For  example,  a 
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se:retary  should  be  able  to  type  in  a  budget;  a  policy  analyst  sliould  be  able 
to  create  new,  modified  budgets  from  one  presently  stored  by  changing  accounts 
or  blocks  of  accounts. 

(2)  Manipulation  and  analysis  capabilities.   Typical  operations  needed 
are  to: 

-  change  numbers  individually 

-  change  them  in  groups  according  to  present  rules  (eg.  increase 
all  accounts  of  a  certain  type  by  10%) 

-  form  standard  aggregations.  (Departmental  and  Secretariat 
totals  should  be  routinely  calculated  and  stored) 

-  compare  budgets  by  taking  differences  of  different  versions. 

-  select  accounts  by  Boolean  criteria  (e.g.  identify  those  accounts 
that  have  more  than  10%  increase  over  last  year  and  are  also 
greater  than  $50,000)- 

The  manipulations  should  be  easy  enough  to  do  so  that  a  policy  analyst 
can  do  them  with  a  few  hours  training. 

(3)  Output  of  informal  and  formal  reports: 

-  informal  tables,  graphs,  intermediate  steps  in  analyses,  etc. 

-  extraction  of  budget  details  on  an  ad  hoc  basis 

-  special  purpose  analysis 

-  Formal  reports  including 

(a)  Frequently  used  summaries  (see  Fig.  1) 

(b)  Basic  information  for 

House  1  (Fig.  2  shows  a  sample  page) 

Appropriations  Bill  (Fig.  3  shows  a 
sample  page) 

Informal  tables  should  be  readily  constructable  by  a  relatively  non- 
technical person.   A  flexible  report  generator  should  be  available  so  that 
a  technical  person  can  set  up  formal  reports  relatively  easily.   Standardized 
formal  reports  should  be  executable  by  one  or  a  few  simple  macro  commands. 
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3.2  Current  Status  of  System 

The  system  has  a  developmental  version  and  a  production  version.  The 
developmental  version  is  on  an  IBM  360-67  at  Brown  University  which  can  be 
accessed  by  local  call  from  MIT  and  the  State  House  through  the  NERCOMP 
communications  network.   The  production  version  is  on  a  commercial  time- 
sharing facility,  TYMSHARE.   The  computer  is  an  IBM  370-158  and  can  be  ac- 
cessed by  a  local  call  in  Boston. 

The  system  is  programmed  in  EXPRESS,  a  high  level  language  that  has 
been  designed  to  facilitate  the  development  of  models  and  flexible  informa- 
tion systems.   Many  of  the  features  required,  including  online  input,  prompt- 
ing, editing,  data  base  management,  array  manipulation,  and  display  are  auto- 
matically provided.   A  program  called  DATA  READER  converts  machine  readable 
input  with  any  standard  format  into  a  data  base  accessible  to  EXPRESS  com- 
mands . 

The  basic  definitions  of  most  key  budget  variables  were  laid  out 
and  declared  to  the  system  in  March  1974.   Data  for  several  versions  of  the 
FY75  budget  were  put  in  during  spring  1974  and  the  system  was  used  in  ways 
described  later  in  the  paper.   The  budget  versions  included: 

APP74  Appropriations  for  FY74  as  appearing  in 

►House  1,  Jan.  74 

REC75  Governor's  recommendations  for  FY75  as 

appearing  in  House  1,  Jan.  74. 

REC75.A  FY75  recommendations  as  ammended. 

H5550.A  House  bill  including  floor  amendments. 

SENATE  Senate  Ways  and  Means  Committee  recommendations 


.  15  . 
In  addition,  several  special  programs  have  been  written: 

(1)  Input  facilitation.   These  routines  provide  special  prompts  and 
permit  entering  numbers  in  the  form  that  users  are  most  comfortable  with. 

(2)  Reporting.   A  basic  command  aggregates  accounts  by  department 
within  each  secretariat  and  lays  out  headings  for  departments  and  secretar- 
iats.  An  adaptation  permits  handling  the  Constitutional  Officers.   An  over- 
all title  and  grand  total  is  provided.   Appendix  2  shows  a  sample  report  of 
this  type.   A  more  general  command  permits  "department-like"  and  "secretariat- 
like"  entities  to  be  defined,  titled,  and  reported.   An  additional  command  can 
be  invoked  to  save  the  definitions  for  subsequent  use. 

System  source  listings  as  of  June  74  are  given  in  Appendix  3. 
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4.   Four  Methodological  Views  ol  the  System 

A  fuller  understanding  of  the  system  emerges  from  viewing  it  from 
the  perspectives  of  four  different  management  science  methodologies  — 
implementation  theory,  information  systems  technology,  models,  and  planning 
and  control  theory.   Each  of  them  contributes  to  the  working  of  the  system. 

4.1   Implementation  Theory 

Management  Science  has  suflered  many  growing  pains  —  limited  or  no 
use  of  study  results,  systems  which  quickly  become  obsolete,  'good' 
solutions  which  are  modified  so  extensively  before  being  put  into  practice 
that  they  become  unrecognizable.   To  a  large  extent  these  problems  stem 
from  our  lack  of  an  effective  theory  of  implementai  Ion,  leaving  us  without 
the  knowledge  needed  to  manage  our  applications.   Recently,  however, 
researchers  have  started  to  study  the  implementation  process  itself,  and 
a  number  of  paradigms  have  emerged.   Those  that  look  most  promising  contend 
that  MS/OR  implementation  is  a  specific  instance  of  organizational  change 
and  bring  the  results  of  research  in  this  area  into  play.   We  have  actively 
attempted  to  do  this.   By  using  the  organizational  change  model  as  a  guide 
to  implementation  and  carefully  re.-ording  the  events  taking  place  through- 
out the  process,  we  hope,  to  learn  more  about  both  the  nature  of  implementation 
and  the  usefulness  of  the  theory  ;is  a  management  tool. 


4.1.1.   The  Organization  Development  Model 

The  theory  we  shall  use  is  the  Kolb-Frohman  organization  develo))ment 
(OD)  model  of  the  consulting  process.   Variations  have  previously  been 
applied  to  MS/OR  implementation  (Lucas  and  Plimpton  [5   ],  Urban  [8   ]). 
The  variation  employed  here  breaks  the  implementation  process  into  sev  m 
steps  and  puts  in  a  number  of  loops  to  make  the  process  iterative.   Th.; 
theory  is  normative;  i.e.,  it  tries  to  say  what  people  should  do,  not 
necessarily  what  they  do  do. 

The  process  (Figure  A)  begins  with  Scouting.   The  manager  and 
management  scientist  assess  each  other's  needs  and  capabilities,  and  ai tempt 
to  determine  whether  a  'fit'  exists.   The  management  scientist  attempt;  to 
'unfreeze'  the  organization  so  as  to  establish  a  basis  for  change.   At  the 
same  time  the  organization  tries  to  influence  the  management  scientist  and 
make  him  cognizant  of  its  spt>cial  needs  (Munson  and  Hancock,  [6   ]). 

During  Scouting  the  management  scientist  tries  to  determine  an 
appropriate  Eii  t  ry  into  the  organization.   Entry  alms  at  developing  an 
initial  n  latlonship  and  basis  for  trust  between  tlie  management  scientist 
and  manager.   A  formal  legal  contract  may  or  mav  not  be  developed  betwc  en 
the  parties  but  a  "psychological  contract"  (Sch<ln,  [7   1)  emerges  th.it 
encompasses  each  party's  expectations,  resources,  and  willingness  to 
influence  and  be  influenced  during  the  implementation.   Client  and  con- 
sultant develop  an  initial,  tentative  statement  of  problems,  goals,  an. I 
objectives.   Note  that  the  relationship  is  between  the  management  scientist 
and  specific  individuals  or  groups  in  the  organization,  not  the  organization 
as  a  whole. 
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Figure  /, ;      The   Organization   Development  Model   of    frnplementiiCion 
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If  entry  is  successful,  the  process  moves  to  Diagnosis.   This  focuses 
on  refining  the  statement  of  problems,  goals,  and  objectives  developed  in 
rough  form  during  entry.   The  manager  and  management  scientist  jointly  agree 
upon  criteria  and  measures  for  evaluating  any  proposed  solutions  or  actions 
taken.   These  criteria  will  function  in  both  the  Planning  and  the  Evaluation 
stages . 

Planning  seeks  alternative  ways  to  solve  the  problem.   Each  alter- 
native is  evaluated  according  to  the  criteria  agreed  upon,  the  resources 
required,  and,  most  critically,  the  effects  on  various  individuals  and 
groups  in  the  organization.   If  the  desired  alternative  involves  people  or 
groups  not  already  included  in  the  'contract',  the  participants  must  cycle 
back  and  renegotiate  entry. 

When  an  acceptable  alternative  emerges  and  all  relevant  parties  are 
'brought  on  board',  the  process  moves  to  Action.   This  entails  the  actual 
intervention  and  corresponds  to  what  is  traditionally  called  implementation. 

Assuming  no  serious  disruption  during  the  Action  phase,  the  process 
enters  Evaluation  and  Assessment.   Client  and  consultant  evaluate  the  new 
situation  against  the  previously  set  criteria  and  make  a  careful  analysis 
of  possible  further  changes.   If  necessary,  the  process  cycles  back  to  an 
earlier  phase.   Otherwise  the  process  moves  to  Termination  and  the  manage- 
ment scientist  and  manager  cease   active  work  on  the  situation. 

We  wish  to  stress  certain  characteristics  of  implementation  that 
are  implicit  in  the  OD  model.   The  process  covers  the  entire  span  of  system 
development,  not  just  that  part  traditionally  termed  implementation.   Tlie 
process  is  evolutionary,  arriving  at  a  pood,  workable  solution  by  a  series 
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of  iterations.   Throughout  the  entire  process  both  management  scientist 
and  manager  play  active  roles,  each  making  important  contributions  to  the 
final  outcome.   The  outcomes  involve  more  than  simply  success  or  failure 
as  usially  recognized  in  the  MS/OR  literature  because  many  types  and  degrees 
of  systematic  change  are  possible. 

4.1.2.   Chronology  of  implementation  at  A&F 

In  a  certain  sense  implementation  had  been  underway  for  three  years 
prior  to  thi  appar .nt  start  of  the  project.   During  this  time  members  of  the 
Management  Science  Group  at  the  Sloan  School  (primarily  Professor  Little 
and  various  gradual e  students)  had  worked  on  several  projects  to  provide 
members  of  the  executive  branch  with  simple  management  science  tools  for 
policy  analysis.   Out  of  this  background  grew  a  series  of  informal  meetings 
among  the  authors  between  November  1973  and  February  1974.   They  discrssed 
simple  decision  support  systems  to  aid  state  planning  and  control  proc  ?sses. 
A  particular  system  emerged  as  a  good  starting  point;  this  was  a  simpK* 
interactive  system  that  would  enable  A&F  to  retrieve  and  manipulate  builget 
data  easily  and  flexibly.   A  number  of  current  problems  that  the  system 
could  alleviate  were  stated  by  Smith  : 


Although  a  system  with  ostensibly  the  same  capabilities  as  the 
one  described  here  already  exists  within  state  government  (the  Budget 
Bureau's  Budget  Prep  system),  it  does  not  meet  A&F's  needs.   Largely,  this 
is  because  the  Budget  Prep  system  was  designed  to  be  a  source  of  highly 
accurate  historical  information.   It  can  only  function  with  data  broken 
down  to  the  subsidiary  account  level,  and  this  data  is  not  normally  avail- 
able until  near  the  end  of  the  budgeting  cycle.   A&F  needs  a  system  which 
can  provide  flexible  support  to  the  budget  making  process  as  it  progresses. 
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1.  A  constant  difficulty  in  keeping  track  of  the  impact  of  supplemental 
and  deficiency  allocations  on  the  overall  budget  of  the  Commonwealth; 

2.  A  lack  of  any  existing  mechanism   for  systematically  comparing 
budgets  or  for  projecting  future  budgets  from  existing  ones;  and 

3.  A  difficulty  in  matching  sources  and  uses  of  funds  in  any  given 
budget.  (This  problem  is  exacerbated  when  there  are  frequent  changes 
in  one  or  the  other  side  of  the  budget,  as  is  the  case  in 
Massachusetts. ) 

The  meetings  together  with  our  history  of  working  with  A^V   and  other 
state  agencies  comprised  the  Scouting  phase.   We  emerged  with  a  clear  notion 
of  where  to  start  (both  in  terms  of  the  particular  system  and  the  appropriate 
people  to  be  working  with  —  Smith  and  Dr.  Edward  Moscovitch,  Deputy 
Commissioner  for  Fiscal  Affairs  in  the  Department  of  Administration  and 
Finance),  and  with  a  definite  'felt  need'  for  change  among  parts  (at  least) 
of  the  primary  client  group. 

Between  mid-February  and  mid-March,  1974,  we  engaged  in  the  Entry 
phase.   Moscovitch  was  identified  as  the  'ultimate  user'  of  system  output 
and  thus  became  the  focus  of  entrv  activities.   A  member  of  the  M.I.T. 
team  coded  up  a  very  simple  data  manipulation  capability,  and  we  demonstrated 
it  to  Moscovitch.   By  means  of  this  and  subsequent  meetings  we  reached  a 
consensus  that  we  would  develop  a  Phase  T  system,  having  limited  capabilities, 
but  meeting  some  of  the  objectives  which  had  been  outlined.   The  system 
was  to  be  a  first  step,  and  our  experience  with  it  would  permit  us  to  define 
extensions. 

Much  of  the  activity  classified  as  Diagnosis  and  Planning  actually 


.  22  . 


occurred  during  Scouting  and  Entry  in  our  case.   However,  certain  Diagnosis 
and  Planning  activities  did  take  place  after  Entry  had  been  successfully 
negotiated.   Thus  Moscovitch,  Smith,  and  Ginzberg  refined  our  mutual  under- 
standing of  goals  and  objectives,  and  developed  an  initial  (and  rather  rough) 
set  of  criteria  for  system  evaluation  in  late  March  and  early  April.   These 
steps,  in  fact,  overlapped  the  Planning  and  Action  stages. 

As  the  bulk  of  Planning  activities  had  taken  place  in  earlier  stages, 
there  was  no  distinct  Planning  phase  before  the  physical  implenientation, 
the  Action  stage,  began.   This  arrangement  seemed  adequate,  since  all 
those  directly  affected  by  the  system  took  part  in  the  decision  to  implement. 
However,  in  parallel  with  the  systems'  physical  development,  we  began  to 
consider  groups  who  were  not  of  necessity  involved,  but  nevertheless  might 
benefit  from  the  system.   The  outiome  was  a  series  of  low  key  meetings  and 
conversations  between  members  of  the  A&F  policy  Analysis  Staff  and  key 
members  of  legislative  and  executive  branch  staffs.   The  aim  was  to  introduce 
the  system,  show  them  how  it  might  help  them,  and  offer  to  let  them  use  it. 
Underlying  this  desire  to  broaden  the  system's  user  base  was  the  assumption 
that  this  would  lead  to  better  coordination  amcng  all  the  actors,  and  hence, 
larger  benefits.   As  a  final  step  in  attempting  to  "sell"  the  system  to 
additional  audiences,  Moscovitch  held  a  press  briefing  at  which  the  system 
produced  (and  he  discussed)  a  comparison  report  of  three  budget  proposals 
(Senate  vs.  House  vs.  Governor)  just  one  day  after  the  Senate  Ways  and  Means 
Committee  had  reported  out  their  proposal. 

Svstem  use  was  relatively  heavy  from  mid-April  to  late  May.   This 
history  plus  the  previously  defined  evaluation  criteria  provide  inputs  to 
Evaluation  and  Assessment.   We  shall  review  this  more  fully  in  a  later 
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section  of  the  paper.   Here  we  highlight  certain  aspects  of  the  evaluation 
process.   A&F's  efforts  to  gain  a  wider  audience  for  this  system  were  quite 
successful;  other  executive  branch  offices,  legislative  staff  members,  and 
and  the  press  have  all  responded  favorably.   As  a  result,  we  found  it 
necessary  to  rethink  our  definition  of  the  clients.   The  A&F  Fiscal  Affairs 
Staff  is  still  the  major  client  and,  indeed,  the  only  user  of  the  physical 
system.   However,  the  legislative  and  executive  aides  who  wish  to  use  the 
system's  output  are  now  seen  as  important  groups.   The  emergence  of  new 
clients  leads  us  back  to  the  entry  stage;  we  must  Identify  the  needs  and 
wants  of  these  groups  and  negotiate  a  "contract"  among  the  various  parties  — 
the  staff  groups,  A&F,  M.I.T.,  etc.   This  requires  a  new  cycle  through  the 
process  with  interviews  and  discussions  with  appropriately  identified  people. 

In  conjunction  with  this  "cycling  through"  with  thi>  new  clients,  we 
must  also  look  at  A&F's  next  level  of  needs.   The  system  evolves  iteratively. 
We  have  learned  something  about  A&F's  needs  for  analytic  support,  and  we 
have  begun  sketching  out  possible  directions  for  extending  the  Budget 
Preparation  and  Tracking  System  and  for  developing  independent,  but  related, 
systems. 

To  summarize  our  discussion  of  implementation  theory  we  should  ask 
what,  if  anything,  we  have  learned  about  implementation.   Since  we  were 
intimately  involved,  we  cannot  make  the  obiectlve  statements  of  dispassionate 
researchers.   However,  we  feel  the  OD  model  helped.   Tlie  benefits  manifested 
themselves  largely  through  the  "Oh,  yeah"  phenomenon;  when  one  of  us  would 
raise  an  issue  suggested  by  the  OD  model,  another  would  say,  "Oh,  yeah,  we 
should  have  thought  of  that".   If  the  model  is  rich  enough  to  give  experienced 
Implementors  insight  into  the  process,  then,  we  contend,  it  can  be  a  useful 
tool  in  the  management  science  bag. 
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4.2.   Information  Systems  Technology 

From  an  information  systems  point  of  view  the  budget  system  is  both  very 
high  and  very  low  technology.   It  is  high  technology  in  that  it  uses  sophisti- 
c  ited  machines  and  software.   It  is  low  in  the  sense  that  the  functions  to  be 
performed  are,  at  least  superficially,  simple. 

The  system  has  been  developed  on  an  IBM  360-67  at  Brown  University, 
accessed  as  a  local  Boston  call  through  the  Nercomp  network.   A  production 
version  is  running  on  TYMSHARE,  a  commercial  facility.   The  system  is 
programmed  in  EXPRESS,  a  high  level  "system  building  system".   This  is  an 
interactive  language  used  to  build  on-line  models  and  flexible  Information 
systems  designed  to  assist  managers  in  the  solution  of  relatively  unstructured 
problems.   EXPRESS  provides 

(1)  data  base  management:  easily  used  commands  to  organize,  access, 
and  maintain  online  data 

(2)  commands  to  manipulate,  display,  and  analyze  data 

(3)  a  user-oriented  language  for  interfacing  with  data  and  programs 
and  for  creating  new  data  bases,  programs,  models,  and  commands 
that  customize  the  system  for  the  user. 

The  philosophy  behind  contemporary  computer  use  is  to  make  the  com- 
puter solve  its  own  Internal  problems  without  a  great  deal  of  instruction 
from  the  user.   Thus,  to  see  the  first  10  accounts  in  an  amended  Senate  budget, 
named  SENATE. A,  the  user  types 

ACCT  1  TO  10 
TBL  SENATE. A 


The  computer  then  displays  the  account  numbers  and  budget  figures,  solving 
the  formating  problem  by  itself.   If  the  user  does  not  like  the  particular 
format,  commands  are  available  to  override  it  and  do  something  else.   In 
executing  a  simple  request  like  the  above  the  computer  is  also  solving 
many  internal  problems  that  the  user  does  not  begin  to  want  to  know  about. 

Experience  in  building  models  and  systems  for  managers  over  the  past 
few  years  has  led  to  the  approach  taken  here:  Start  simply  and  evolve.  So 
far  we  have  built  a  budget  display  and  comparison  system.   As  users  request 
further  capabilities,  we  shall  add  them.   No  attempt  has  been  made  to 
foresee  all  needs  in  advance.   The  use  of  a  high  level  liriguage  permits 
redesigning  and  adapting  the  system  with  relative  ease. 

The  Information  system  functions  now  being  performed  in  the  Budget 
Tracking  System  are: 

1)  Data  Input 

2)  Editing 

3)  Display  (for  informal  purposes) 

4)  Reporting  (in  special  formats  for  formal  purposes) 

5)  Aggregation  (Various  totals  and  subtotals) 

6)  Manipulation  (For  example,  the  caUulation  of  differences  between 
versions  of  the  budget) 

These  are  simple,  standard  operations  but  the  details  are  subject  to 
change  without  notice. 

As  time  goes  on,  the  system  will  be  extended  to  handle  "program 
budgets".  A  program  budget  collects  individual  accounts  relevant  to  a 
specific  purpose  from  individual  agency  budgets  and  displays  them  together 
as  a  single  entity.   An  illustration  of  this  is  the  so-called  Children's 


26 


Budget  which  pulls  together  items  from  Welfare,  Education,  etc.  into  an 
overall  view  of  state  activity  for  children. 

4.3  Models 

At  present  the  system  is  virtually  devoid  of  formal  models  in  an  opera- 
tions research  sense.   Of  course,  the  budget  itself  ts  an  abstract  structure 
of  dominating  importance  to  theoperation  of  government  and,  in  a  sense,  is  a 
financial  model  of  the  state.   However,  we  treat  this  artifact  more  as  a  special 
form  of  reality  than  as  a  model  of  it. 

The  current  system  does  have  certain  capabilities  which  can  be 
considered  models  of  a  very  elementary  form.   The  ability  to  define  groups 
of  accounts  into  meaningful  entries  (e.g.,  departments,  secretariats,  or 
programs),  and  to  display  and  operate  on  these  entities  separately  from 
other  budget  accounts,  is  about  the  extent  of  models  at  this  point. 
However,  this  is  only  the  present  state.   The  system  can  expand  to  incorporate 
more  sophisticated  models.   Our  view  for  the  future  is  of  a  central  budget 
module  which  is  fed  by  (and  may  in  turn  feed)  several  specialized  models 
(e.g.,  tax  revenue,  welfare  expenditure,  etc.).  The  central  structure  now 
exists,  and  models  will  be  added  as  the  client  perceives  their  usefulness 
and  learns  to  handle  their  mechanics. 

4.4.   Planning  and  Control  Systems 

The  literature  on  the  design  and  implementation  of  planning  and 
control  systems  lias  largely  focused  on  profit  making  organizations,  and 
frequently  on  only  a  .sub-si't  of  iliose,  the  large-  d  i  v  i  s  iona  1  Ized  corpora- 
tions.  The  need  for  planning  and  control  activities,  howevi-r,  i-xisls  In 
all  organizations,  public  and  private,  small  or  large. 
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To  understand  the  planning  and  control  issues  addressed  by  our 
system,  it  is  necessary  to  consider  both  the  current  planning  and  control 
activities  in  A&F  and  some  normative  views  of  the  appropriate  structure 
for  these  processes.   Anthony  [  3   ]  provides  a  simple,  but  useful, 
normative  framework.   He  divides  planning  and  control  into  three  related 
sets  of  activities  (Figure  5).   Strategic  Planning  decides  organizational 
objectives  or  missions,  and  the  policies  governing  the  .icquisition  and 
use  of  resources.   Management  Control  assures  tiie  efficient  and  effective 
use  of  resources  in  meeting  the  organization's  objectives;  and  Operational 
Control  is  "the  process  of  assuring  that  specific  tasks  are  carried  out 
effectively  and  efficiently"  (Anthony,  p.  18).   These  three  sub-processes 
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i 

MA.\AGEMEN  1'     1 
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IRUL            1 

Figure  5:   Anthony's  Framework 


form  a  heirarchy,  each  lower  process  (see  Figure  5)  being  constrained  by 
the  ones  above  it. 
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The  Department  of  Administration  and  Finance  deals  principally 
with  Management  Control  and  Operational  Control.   That  is,  A&F's  mission 
is  the  analysis  and  control  of  the  fiscal  affairs  of  the  Commonwealth, 
and  it  must  operate  within  the  constraints  set  down  by  the  legislature 
and  other  parts  of  the  executive  branch. 

The  planning  and  control  systems  existing  in  A&F  prior  to  the 
development  of  the  budget  tracking  system  focussed  primarily  on  issues  of 
operational  control  —  e.g.,  tracking  of  expenditures  against  the  enacted 
budget.   The  budget  tracking  system  provides  A&F  for  the  first  time  with  a 
tool  to  support  the  management  control  process,  i.e.,  to  assist  budget 
making  as  opposed  to  expenditure  tracking.   The  system  assembles  data 
from  diverse  sources  into  meaningful  forms,  enables  identification  of  needs 
for  more  or  better  data,  and  allows  the  manipulation  of  this  data  to  examine 
the  impacts  of  different  policies  on  resources  and  probable  outcomes. 

5.   Evaluation  of  the  System 

5.1   Measures  of  Performance 

We  consider  three  categories  of  performance  —  costs,  including  both 
money  and  time;  short  run  benefits  or  changes  in  operations:  and  potential 
future  benefits. 

On  the  cost  side,  three  variables  are  of  particular  interest.   Firsi, 
is  money.   The  actual  dollars  expended  on  system  development  and  use  to  date 
have  been  quite  small,  totaling  less  than  $10,000,  and  the  bulk  of  this 
going  for  computer  time  for  productive  system  use.   Even  so,  there  Is  a 
tradeoff  between  monetary  cost  and  time  cost,  and  by  our  selection  of  a 
high  level  modeling  language  we  have  opted  to  spend  dollars  in  return  for 
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ease  of  physical  inplez-entation  and  use  (though  cost  vas  acfaally  rather 
low  because  of  our  using  the  relatively  inexpensive  Brovn  University  systes 
during  the  research  pb^se  of  our  project).   The  next  cost  is  the  tiae 
required  by  particular  individuals.   >n  the  M.:.-.  sice  -_'-~^-    -'      =  were 
involved  —  Little,  Johnson,  and  Sinz-erg.   Oiir  average  i-   .    -  :  ranged 
frot:  three  to  six  hours/veek  fron  nid-March  through  June,  and  it  is  doubtful 
that  any  of  us  ever  spent  3ore  than  ten  hours  in  a  veek.   On  the  A&r  side 
tvo  people  (Smith  and  Huston)  were  the  prJTV.ry  participants,  and  spent  an 
average  of  about  ten  hours /week  each  on  systen  maintenance,  use,  and 
related  activities.   Jr.e  final  c?st  is  the  calendar  tine  required  for 
systen  de%-elopnent .   The  chronology.-  presented  earlier  shows  that  calendar 
time  was  minimal;  "he  capabiliti'js  desired  for  phase  T  as  determined  in 
mid-March  plus  a  few  additional  ones  were  available  by  the  last  week  of 
April.   We  should  note,  also,  that  an  initial  "bare  bones"  capability 
became  available  within  two  days  of  the  decision  to  inple3ent  a  phase  I 
system.   This  speed  is  a  direct  result  of  the  hish  level  language. 

The  second  area  of  performance  is  that  of  short  run  obser\'able 
benefits  and  changes.   Tnese  are  the  -hanges  that  occurred  in  the  budgeting 
period  ending  July  1,  197-.   Ve  divide  them  into  five  classes  —  capabilities 
provided,  knowledge  and  understanding  gained,  process  changes,  iaproved 
inter-organizational  relationships,  and  labor  displacement. 

In  the  first  area,  the  capabilities  provided,  we  have  already 
suggested  that  t";e  ohase  Z   svstem  provides  A&F  with  enhanced  anal  'tic 
capabilties.   Their  use  so  far  has  included  comparisons  among  pro] osed  and 
existing  budgets  and  production  of  hierarchically  organized  suaoarv  reports. 
While  this  may  seem  mcdest.  it  i?  mot'  than  was  previously  available,  and 
the  canacitv  for  mere  sonhisticated  work  now  exists. 
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In  the  case  of  knowledge  and  understanding  gained  there  appears  to 
be  some  considerable  progress.   Key  figures  in  A&F  (particularly  Moscovitch) 
seem  to  have  a  better  understanding  of  the  budgeting  process  and  of  the 
contents  of  specific  budgets.   Such  increased  understanding  permits  better 
control  and  intervention. 

The  third  area,  change  to  the  budgeting  process,  has  not  lieen 
particularly  noticeable.    Obviously,  any  use  of  a  new  system  where  none 
existed  before  reflects  change.   However,  this  Is  minimal  compared  to  the 
possibilities.   The  inertia  of  an  existing  budgeting  process,  is,  of  course, 
monumental  and  it  should  be  noted  that  the  tracking  system  was  brought  up 
quite  late  in  the  year's  cycle;  hence,  any  use  of  it  had  to  be  ad  hoc. 

Some  initial  signs  of  change  .ire  showing  in  the  fourth  area,  improved 
inter-organizational  relationships.   The  A&F  Fiscal  Affairs  Staff  was  a  new 
(one  year  old)  and,  in  some  sense,  experimental  group  within  the  exucutlve  branch. 
The  development  and  use  of  the  phase  T  system  helped   the  group  to  show 
its  usefulness  to  the  legislature.   That  this  was  successful  can  be  inferred 
in  part  from  the  legislature's  action  in  approving  an  increased  budget  for 
this  group's  activities  in  the  coming  year  (earlier  in  the  year  it  was  not 
certain  that  the  group  would  obtain  a  budget  to  continue  at  all). 

The  final  area,  labor  displacement,  is  minor.   Certainly  some  manual 
tasks  —  e.g.,  adding  up  budget  numbers  for  policy  analysis  —  have  been 
transferred  to  the  comp>  ter.   Hov/ever,  the  additional  tasks  which  the  system 
m;ik.es  possible  more  than  offset  <iny  labor  savings. 

When  we  turn  to  the  third  basic  category  of  performance  measures, 
potential  future  benefits  and  changes,  we  find  the  same  five  classes  of 
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When  we  turn  to  the  third  basic  category  of  performance  measures, 
potential  future  benefits  and  changes,  we  find  the  same  five  classes  of 
variables  as  for  existing  changes.   In  each  instance  we  expect  to  see  future 
progress  along  lines  already  started: 

1.  Further  analytical  capabilities,  assuring  greater  consistency 
of  assumptions,  and  hopefully,  more  realistic  budgets; 

2.  Increased  understanding  of  the  budget  and  the  budgeting 
process  on  the  parts  of  all  key  figures  involved; 

3.  Greater  use  of  the  computer  as  an  integral  .lid  to  the 
budgeting  process; 

4.  Greater  inter-departmental  cooperation  in  producing  the 
budget;  and 

5.  More  new  tasks  being  performed,  both  by  humans  and  by  machines. 

5.2   Progress  towards  predefined  criteria. 

The  OD  model  implies  evolution  should  take  place  in  the  context  of 
predefined,  mutually  agreed  upon  criteria.   Has  this  happened? 

Two  sets  of  objectives  were  established.   The  first,  longer  range 
group  included: 

-specific  system  capabilities,  Including  those  of  phase  I, 

but  going  well  beyond; 
-developing  a  greater  understanding  of  the  budget  and  the 

budgeting  process; 
-developing  specific  analytical  models  which  would  enhance 

understanding  of  cause-effect  n  lationshlps  In  the  budget;  and 
-developing  mutual  understanding  and  cooperation  between  A&F 

and    tlie    legislature. 
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As  can  be  seen,  we  have  made  good  progress  towards  these  long-range  objective 
The  second  set  of  objectives,  defined  for  phase  T,  were  more  modest. 

-being  able  to  add  up  and  cross  check  the  budget  on  a  computerized 
system; 

-being  able  to  compare  different  versions  of  the  budget; 
-being  able  to  generate  reports  on  the  budget  's  status  more 
quickly  than  was  previously  possible,  and  being  able  to  update 
these  reports  more  frequently; 
-establishing  the  basis  for  a  better  relationship  between  A&F 
and  other  sections  of  the  state  government. 
The  evidence  indicates  that  all  of  these  objectives  have  been  met.   The 
success  in  meeting  the  phase  I  objectives  and  the  progress  towards  the  long 
term  objectives  leaves  us  in  a  good  position  to  begin  the  next  cycle  of 
system  development. 

5.3   On  diagnosing  the  status  of  the  impi emental ion 

A  key  aspect  of  the  OD  model  is  Its  diagnostic  orientation;  favorable 
implementation  outcomes  can  only  be  reached  if  we  know  where  we  are,  how  we 
got  there,  and  can  devise  strategies  and  tactics  to  move  forward. 

Our  self  diagnosis  begins  by  Identifying  "incompletions"  in  the 
implementation  along  three  dimensions  —  attainment  of  organizational  objec- 
tives, learning  of  new  task  procedures  and  roles,  and  refreezing  these 
changes  into  the  organization's  operations.   We  look  briefly  at  each.   The 
original  objectives  have  been  achieved;  however,  objectives  are  evolving 
and  will  require  further  efforts.   Learning  of  new  task  procedures  and  roles 
lias  been  good  within  AS.F,  but  tliese  too  are  evolving  and  so  addllional 
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learning  will  have  to  take  place  and,  as  yet,  there  has  been  little  learning 
or  change  in  other  departments.   Finally,  it  is  too  early  for  refreezing. 
Within  A&F  there  is  significant  commitment  to  a  system,  but  with  the  system 
still  evolving,  we  do  not  expect,  nor  do  we  want,  commitment  to  the  current 
version  of  the  system.   Outside  of  A&F  there  is  no  commitment  to  any  system, 
but  there  is  also  no  apparent  hostility  to  the  concept. 

Turning  to  strategies  and  tactics,  some  straightforward  suggestions 
emerge.   Wf  should  continue  with  a  second  iteration  through  the  01)  model. 
In  doing  this  we  must  remember  that  we  have  identified  new  groups  of  clients, 
and  must  involve  them  in  the  process.   Since  no  problems  have  appeared,  we 
need  not  take  special  corrective  action,  but  we  should  continue  to  monitor 
progress  to  assure  a  successful  conclusion. 

6 .   Summary  and  Conclusions 

With  the  help  of  a  high  level  computer  language,  an  online  system  for 
the  storage,  retrieval,  and  easy  manipulation  of  the  data  in  the  Massachuset t; 
state  budget  has  been  developed  and  put  into  use  in  a  short  time  at  little 
cost.   Conscious  use  of  organizational  development  methodology  has  smoothed 
the  introduction  process.   The  system  has  performed  up  to  expectations  and 
seems  well  on  the  way  to  becoming  an  integral  part  of  the  budget  preparation 
and  analysis  process. 
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Appendix  1.   Herald  American  Clipping 


Computer  Compares  Budget  Plans 


By  BOB  CREAiMER 

--In  a  comer  outside  the  State  House  office  of  Edward 
Moscovitch,  a -telet>pe  ■  machine  clattered  throughout  the 
afternoon  yesterday,  pumping  out  vital  statistics  on  the  pro- 
posed record-high  slate  budget. 

Moscovitch,  deputy  commissioner  for  fiscal  affairs  ire  Ad- 
ministratioa  and  Finance.-hovered  happJy  over  the  machine 
as'  it  produced  a  new,  computerized  summary  of  the  House 
and  Senate  budgets  and  how  they  compare  with  the  $2.7S3 
billion  one  requested  by  Gov.  SargenL 

The  new  computer  system  was  developed  jointly  by 
Moscovitch's  staff  and  a  management  studies  group  it  MIT, 
and  figures  produced  yesterday  were  courtesy  of  a  Brpwn 
University  computer,' 

If  Moscovitch's  new'. toy  continues  to  think  correctly,  it 
hopefully  will  produce  comparisons  of  how  S.irgent,  the  House 
and  Senate  stand  on  all  1200  items  in  the  new  budget. 

.  TTie  House  has  voted  a  $2,743  billion  budget  and  the  Senate 
version,  $2,747  billion.'  comes  up  for  debate  Monday.  .,-,  . 

Moscovitch  said  he  hopes  by  then  that  the  computer  will 
have  pnxluced  a  variety  of  figures  and  comparisons  Lhat  can 
be  used  by  the  40  senators. 


When  the  House  voted  on  the  budget,  he  said,  memben 
had  only  the  Ways  and  Means  Committee  figures  and  nothing 
on  the  1974  budget  and  the  new  one  from  the  governor. 

The  computer  figures  showed  Moscovitch  that  the  major 
changes  in  the  Senate  budget  are  reductions  in  Medicaid  funds 
and  increases  for  the  State  Police,  economic  development  and 
a  series  of  management  improvem.ents  in  administration  and 
finance. 

He  Said  that  the  Senate  budget,  like  Sargent's  calls  for 
across-the-board  cuts  which  would  have  the  effect  of  reducing 
the  amounts  actually  available  to  state  agencies  by  about  four 
percent  below  the  amounts  appropriated. 

While  Moscovitch  appeared  more  pleased  with  the  Senate 
figures,  as  compared  to  the  House's,  he  predicted  that  the 
Senate's  S27  million  cut  in  Medicaid  funds  "may  mean  the 
funds  will  run  cut  before  the  year  is  finished"  because  Med- 
icaid costs  Will  rise  some  five  percent  next  year  due  to  inlla- 
tion  and  other  reasons.  •  ...  ■ 

In  a  slap  at  the  House,  he  pointed  out  that  the  figures 
show  the  Senate  accepted  most  of  the  new  State  Police 
troopers  recommended  by  Sargent  "to  provide  extra, patrol 
during  high-drinking  hours  and  thereby  reduce  fatalities  caus- 
ed by  drunken  driving." 

The  governor  asked  for  210  new  troopers  but  the  House 
provided  for  only  50.  In  the  bill  before  the  Senate,  there  is 
money  for  107  troopers. 
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X  ••    f                                       .-          .    p. 

P  ^  1^  1  ?  5  ?.  ?.  S  ^.  r  :  5 

t  r-  <  r--  —  £.  ~  E.  —  .-.  £.    1    r- 

.1  X  ^  r  c  --.  s  e:  s  s  1    c 
r-5^-xE.rE:c:-s   i    a. 

CCCX-r^TE^          S.2. 
.  —  r:  c  X  <  -'  -r.  ^        =.    i    -^ 

=      -    ^          "  : ;: 

c;  o  c;  r;  -7  ---..-  s  -.    i    .5 
cv.  X  c^  X  c;  --.  r.  :^  »-  c»   ■    - 
J-.  >r  .-.  a  a  -  r,  r.       -5   1   s 

«;  X  c^  c  c  X  r!  r"  ^-:       .-^   1    x 

•  <  r;  i.  X  r  -  c  .-       s   1   ^ 
/)c«-c.\-7^r-c-       ^ix 

b''  —  x-^i^"^-'        p^.   lc^ 
to       •.•?•.—        tf-             r-.   ,    s. 

K  =;  ^  .^  :h  .^  £  2  "  s  1  s. 

B5^^|HI^  i  ^ 

•»  <£  !r  IN  r»  ^  X  .--  .-~  --        .    c 
>  r~  ■:  >-c  c.  0  --.  :»  -  .-        .    e. 

31 ""  -  ^  <  i  -t  >r    -*     .  c> 

r  C  §  ?.  £  ~  c  r  H  ?   I   --5 

=  s.J-.nr---^-x--=-<   « 

s  r.  c  .-.  .-  c-  c  X  ^  :>  •   c 

.'  r»  -  7-  s.  r-  ^  -.  ;■  V  .   c 
r.r5xC5.xr:x.-r-   •   — 

i  i!  r  1 5:  -  i  ?.  c  ^  -  I  ^ 

<.  r-.  y  -.  c-  --~  .-  Ji  r.  r  .--   ■    i 

c>  Ji  0  er  ~  ~  c  .-  -  c    I    S 
E.  .'.  w  .--  i  -  r.  X  .-  -'-   ■   -5 

tc  —  cr£--~-r^  1  r^ 

S"cpn!S!i? 

^ 

■c 

.' 

- 

~ 

i" 

•; 

c. 

.-. 

X 

> 

c 

•■- 

i" 

? 

X 

-• 

— 

.-- 

-"- 

C   X 

_ 

^ 

^ 

_ 

J. 

£. 

.. 

^ 

_- 

■a 

•  r~ 

•^  < 

X 

_ 

.i. 

?. 

c 

£ 

r 

~ 

•c 

3. 

J.  n 

t 

.-. 

X 

.-• 

s 

~ 

•^ 

•^ 

, 

c 

r 

.-. 

- 

s. 

- 

^ 

c 

■r 

•n 

•■^ 

X 

X 

— 

— 

- 

X 

fl,' 

_; 

r 

S-- 

S-. 

•« 

^ 

^ 

ji 

Xi 

,^ 

- 

■I 

r-. 

J. 

-t   -S 

i 

:.  • 

* 

" 

' 

, 

. 

.% 

_ 

^ 

r. 

•o 

L 

V 

< 

>' 

- 

r 

J- 

r. 

< 

rfi 

.^ 

^ 

^ 

>-^ 

c 

< 

^ 

^ 

c 

:-  5. 

c 

s. 

- 

.- 

?• 

X 

-•^ 

». 

i' 

»• 

a.  «. 


«  2  </'  >•  t--  <.  —  C 

:=<:.>-c.=;3«.=: 


r  u.  in  —  c  c 

u-iLc  —  —  coc  Oi 
VI  i  .;-  ^  ^  ^  ;j  iT.  _'  £ 


C   i.-   C    3 


C    £.   -  9    ^   =.   « 


?-cc::~c:t;s£. 


c  -'.  r-  r  ^ 


i.  ■=  —  J-- 
c  ^.  —  i  £ 


_•  —  ^  ^ 
x  c  c  >-. 


.-  ^   ^   ^   S.   .   — 


C    C    _   :~   S 


nir!E.s.sr<-^"-r- 
r-  c  a;  «:  =.  i  -•  i  s  .— 


-  —  ^  c  c  i.  r-  s  -- 
--  i-  =.  r-  --  s.  r.  E.  ~ 


SE.SI.SSS.S.S 
c    -   S   C   -.   C   S.   i   u 

.%  -'  e'  i  i  c  :£  s  £ 
.-  c  «?  I.  X  ^  s.  i-  & 
-.-.--.£.-*   Ci  O.   E 


r.  •=  s  i 
••&■■   — 


<1  2.  Z  !-  i 

a  <:  u:  c  i 

b:  o  ^  f. 
c  «- 

c:  c-  i^  u  y 


C  C  :-  w   _; 


•    •    •  a;  - ■_'  3  r 

-  £■  -  *^-  „  f  ^  "'"r  =  " 


«  -.  ^  i  i  J.  -i  s.  ;;  o 


Sf-i--i-:>2-;-i 


i.         C  J.   sr   a.  —   3 

«.   —  C  2   J-.  I- 

c  £  b.  ^  <:.        w  ;; 
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^   M   Ul   J^  V, 

in  n 


s  e  c  -c  CT-  I  o> 


<r  o 

«. 

r 

c  -i  ^  n  cj  E 

e  f  <;  X  £ 

r  --  ^. 

r.  —  1',  _  ,»; 

t^  Ci   O   C   C    .^ 

■N       cvi  X  o  1/1  r^ 
c       t^  o  <\,  in  e. 


J^  c  -J  —  jn  r» 


Cr-       c:xcc.aif;ifi 


G  cc  Ji  —  c  r-  ji 

>C    :>    a-    X.  -    C  -T    ,-~    J1    0 

■^i-T  —  J",  c:  cvi4^c-c 

•   -r.  -  I  ci;  vT  .-  X  J)  r^  r- 


C.  r-    I    ,-~ 


<V'  I  a 


-o  c 

•    J.    -5    -O    X 

c-  en  s  ^j 


.  f»   <X   (\  C    -\'   —   f    a;  I  c\, 

<J.  .--  <7  <;  .-)  ^  ji  j^  c^  ^  ^  [  J; 

•   O'  <■   r".  ~  a  ■x  -v  .1  r.  ■J-  ,  ,c 

;^c\j-O0j<;  x_c^iji  ,  r- 


cvjnsaicci/iji 
■nvOf-ojov  —  >x."~- 


w  <i  J-,  i  o  r,  X  a 


s  '^  n  cc  X  r- 

s  -o  cv;  X  cvj  c\) 


•5  oj  [~  :\.  c. 


a.  G.  c\j  in  ^  ,. 


o.  <ox"GOc.<or-f» 
xi/ir»r->;  —  xcxa. 


^   .  o        .  H  u,  :>  o        . 

W    .  -  u.  c;  IX       c  c 

r.<iu..-yj(-H.:j      1- 

KO-r-ir.  o-ws;^.        H 
«  «  (X         D 

0.  H  jc  c;       u.       u.  w 
t.  a.  ►,  _;  I-       u-       — 


&,;, 


?°t 


1-;  u.  X  c  ^,  J 

i;  -  F-  _•  c  tf 

<1   C  O  D 

u.  c  1.  a. 

4^  .^  c  z  t- 

<-   C  Z  0.  .i  u. 

t  c  <:  c 

ti-  (£  wi  a. 

i:  j^  H  X  s  H 


^F:c^2c25; 


c  w  U-   c 
o  C  :> 
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Appendix  3.   System  Source  Listings  as  of  June  1973 

(JUL     DUUilTb'     Uit-rx     Lfc-Vt-L      lJ*JiJ<3 

UCL     ACCl      U^Ln      iUD^.^nlr'      b '^i  I  ,\(      1      ^j.'iAa     iii)OU     iViX     MCCl-.vJ 

UbL    AUCl.Ut.i     u:;h.n    Lhf^.-^     <     mCCI     > 
LiJ    ACUJL'.Nil     .MAi^lfc. 

UGL     ACCl.iNJA;i     Uifc-K     CHAix     <     ACUl     > 
L^     ACCJUiXfi     (MU^'if-iKK     1-.  I  1  d     UAiriti 
ILf-    r-ul 

UCL     ACUl., MOM     LiClfx     ^^JltCE•.r^     <     AcUl     > 
LU     AUCJU:Mi      (ML-DtK      (\U-^h.KlC) 

UCL     L)LK7^     Litfv     nLALD     <     ACCl      > 

L^     MIA     ULr  1  C  I  t.,\;Cr     n  LC  J.-i.'i  L.Nilj  A  1  I  J.m  ^     MA\f\CH     lj>      1 '>  / ''i 

UCL     A*!h.>jU/:3    Oit.,\     f\LALu     <     ACCi      > 

LJ       1   y'/  D      Ai'ltA'Ut-U      rxt-CO/M'ih-iMUH  1   lo.^J*      /iAkCM       1j*        \^IM 

UCL     t-'LUL(\ML     Ubtn     .tt.AL     <     mCCI      > 
Lu     /o     CaJ/i     rLUcisML     rb,v;i;[,MC 

UCL     mcnv./^r     UoL/v     f\h.><L     <     muCI      > 
L^     L    r  nOi'^    nlGriuMr     ruivul.Mb 

UCL     cLi\tLn,AL     Ubr.n    nt-.HL     <     ACCl      > 
L<J     /o    c  KUi'i     CL.mLi^mL    rui\uI\C 

UCL     tiPiVUil     UiLu     ILK 

ILr^ 

E.NlEK     ACCl..ML-'>      lJJ^J*>'klLr^A(xC(  1  )     >     ilLr^A.\b(J) 

LiMU 

UCL     :3t-.C    Uihi\     iCDiCiNlr     o.'i  I  iv/     1     o-iMA     lu     iVN    iLC.i>-M^i 

UCL     ULr'     UchiN     bUrJiCr^lr     i.'l  1  ,\.      1      J.'IHA      I  Ov)     iV.M     L^fc.K..MA.»i 

DCL     ^jLC.^O     u:2£(\      I,MlKch/%     <     hCC  i      >     Vobo     jLC 
Lo'     ^ihCnt  I  M;\  1  M  i     iNU"^ftr.i\ 

UCL    ut-r.ivij    uoLf\     1  ,>g  I  111  t.f\     <     (4CC1     >     v:^ul)    L/tr" 
Lo     ULl^Mtv  i  .'it-iM  J     i^gUi'iur-fv 

UCL     ^^■C..^JA.1     C:jLfx     C-tMi\     <     it-L,     > 
Lui    it-CuL  1  M.\  !  ai 

UCL     Utr.iV^.^     UoLk     CmAj\     <     IJCr-     > 
Lu     Uhi^rtK  1,'it.M  1 

DLL         '.CI     Uit.;\     CriMfs 
LvJ       - 
iVALuLi: 
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UCL     d.Li^lit/^     UiLr<     I  Lr" 

I  LP 

^'Jf^     MCUl 

UU 

AbK     bH.UJ 

bP.CiVln     (Ui:j(-.CJ 

E,MD 

DCL    BuD«LV    U5tn     ILH 

ILH 

t.NJltfNL     K.viAilL     S  ILf-Ar<bCn(  1  ) 

iti     ,^J;u\A|V,     LE.^jC.1  ri(;M^A,-iL) 


LIbl 

UU 

:iPACL     b 
t^\l     rxiMAMt 
bPACfc.     1 
Pu     AfM\jA,vlt. 
1  fPtL 

Pj/v     bLU 
UU 

dLAi\r, 

1    1    ILh      .»Ot-C.,NiA,v) 

LiLA,vK 
1  r-f-PL     1 


dP.Ul 
tJp.U2 
.  l/.  L'  b 
Llil  : 


UPP    uP.Ul 


bPl 

6Pi 

kUI- 

PUh 

PUn 

UU 

\r     UPP.i\A>i     Pu 

l\U^       IiN/ULiM       ^ 
iVUiNJMi>n  :       L/Ut.:\IIJ 

kU'.-     ii\,ULivji      ID     • 

BLMiMrt      d 

UUt.MU 

r\UlA     jAIP     isPrPAl 

KUK      •L%-nA,\L;      lUlA 

UL/Ai\lr<      ci 
F  i\l  u 


If      iPC     Pu      1 

If  oPL  tvj  1- 
Ulr^  'DPf-HfsP- 
.Uli\     <ni\A,»iP; 


iHP,\i     1 
1P,>J1   •      . 


PL:2p  iPC+lj  - 
PLiL  uP.Ul  + 
.  \A     .5PAUP  3 


'iMUlMp',        bUlU      lMUl^Hl»l 

UUIPILL     UPf'.,NJA:v|     UP(J 


/i    nl  bfi  1 


JVpKLI.NJt     UPL     i')     nIbHl      ?      t-u/ 


1 U I h ( UPr ) 

1 :      lU Ih ( iPC) 


iMAi^l     UdLIiNjp 


L  1  5i  :     lu  It-  U(  ob.L) 


ih;l    f  I  A    uot-  Is    r  u.vjU  1  lUi 

Aivb     1     r^eAL     vALoP 

t,>JU 

UCL     n;:\iAi'-|P     uiPn     lUiM     < 

Lu    Ap^'UAl     i^M.'lp    L  I  Cj  I 


UbL     .^;X.VA,v,      LiPfx      I,vjlLLPfN 

LJ    iNiUM     I  LP     A-^b5 

DCL    dK.Ul     uit-,n     Art-Pi\U     [vILGErt 

LU    BtL-.l,\,\iI,Ml     iJPrAi^  i  .^-it-iM  1     .Mbi^uPi 


LU     tNL»lL\Jb    Utr'Ari  li'iLiM  1     \\J\''itiLn 
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bUL     MtUl..M     UiLn     IDN     <     ACC  1      > 

bCL     rtr.L/J     Uit-K     UMAr 

Lu        - 

t  ACC  1  •  i^jAi'l- 

UUL     lUlF     UitK     cUi\C»lJi\i    KtALU 
Af\U     1      IiMlLLUK     vALuh     ALvsAri      '1' 

LiMD 

UUL  lu  !(•<_')     Lot-K     fLi\ClIOi\    Kt-ALD 

AKb  1      Ii\J  1  tbtrs      VALUt.     ALV.Ar^       '1' 

A«b  c:    ouoiCnir    orllo.NJAL     v/Mf\T[i\b 

I'LL    Arr''/^     Ui,Lr\    nt.ALu     <     MCt  I     > 

L'J    AKf'Kjr'n  1  M  1  1J,\::)     i^i     Mr  r  b  At\  t  i\b     1 1^     HUUit     1>     JmiV     IV  7'. 

i.b)     l^'IA    A^^K«u^^K  I  A  1  I  O.N.O 

UCL    rvtUVb    uit-fN    ntHLu     <     MCC  1     > 

Lu      19713     fXLC'Ji*'l"^it..\UA  1   lOiMo     A:i     MrrLAK  I  iMb      1  l\      HUUbH       1*      JAiNj      I^IA 
bU      IWD      r^LbJi'li^lLi^LvA  1   1  IJiM:2 

DUL     iKtL     Uitr,     iUOiUf<Ir     i/ihNi     1     i,')HA     ^iv^     iv.M     nhL.iMMil 

UCL    kLL.imAi'i     uiL(t     Ib.M     <     IkLL     > 

Lij    tiMltK     iHt    t>jA.it    Uh      Int-     iUdiC/v  If  1  : 

UUL    ^LL..^/»-^     l  i  h  ,s     1  u,M     <     IinLL     > 

Lu     h,Mlt.f\     Irit.    .MMi^h.    ur      IML    Llil     Oh     UAiLbOKr     .MAML:.-: 

UUL     cilllLL     UbLn     LriiAn 

UGL    rvLL.rM^t'i     C'CjLk     I  U.m     <     IfiLL     > 

Lu     Li^Jlt-.K     IriL    ,MM/ib.    Uf      ML    kLLaIIUi^j    bOUL     vAisIadLc.: 

UGL     nil     uit.f\      [UiM 

Lu    ti\i  1  fc.n    .NiA'iK    uK    ilurvL    Abbht-bAlE    :5Uci.GKlfl 

DGL    ni^     U^jLp.     IbiNl 

Lu     t.,\ilt.n     i\.Hi'.'t    UC     Lhii     Abbi^LbAlL     iUooGKlrl 

UGL     rMM'Vi  1     ubhn     IU\; 

UGL     fMNj.»;c^     Ljf-M     liJiM 

UGL     KtL.bt..\i     uiLiN     GrtMi^     <      InLL     > 

Lu     fc.i\  I  b.fx     int.     bL.siL/i  lb     GL<\^b  1  r  I  G  A  I  1  u  a     II  ILK: 

UGL     bhu     u^tK     I.vlLbLiv     <     '.bbl      > 

UGL     ribib.)     Ubh-n     i-iLALU      <      MGbl      > 

LO     HiJLit.     l.Arc;     HiMU    ."iLm.mo     f\LGi.     c  UK     r  f  /  b 


UGL    HtLPu    bbL/x     MPrtiMU 
Lu    / 


UGL     Uk.^f^h^-     UiLr.     I  Lr' 

ILH 

IrvLL     mLL 


wici      ur.ui      LtiMljl  Ml  IntL  .  i  )+  1 

AiK     r.£.L..MM 
A:>K     rcLL.i^ui^. 

KtLAl  I.J.Nj     <!.r\hL  .iMLi^ 

Lu    /- 

frPh      'nLLrlLf     / 

bCL    rtELt-iLt     UbLn     ILr" 

I  LP 

KILLV    Kt-L.iNjA.I 

FILLv    nhL.,\iA 

r   ILhV     r.LL.,MLr: 

f'  ILLV    nLL.  LLiM 

f  ILLV     bi^LLAi  K 

KlMO 

UCL     K"  I  I  ILL     Lih-K     PrvJC 

AkO     1      IiSJltOb--^     vALlL 

UCL     :l.tr<r<l     Ui  Li\     b /mmJ/\ 
Lu     /- 

a«(jU.*iLim  I  b    (VA.-^iHiiLt.   iMMi'itb)    y\bbl    bh    /- 
iUHr-LIhlJ     lU    bUUntr 

UUL     K  biN     bi'r.rv     bM  Ar^ 

UbL     ALlfxtr'     bi>tf\     ILK 

iLr- 

Ir      ILrAnbb     E.b     '      '     5 1  b^vjML     i^.LK/'il 

fc-iM  1  hKL    n.VMi'ih.    .<  1  Lr-'AKbr  r\(  1  ) 

bt-l      l\Kl\Ayi      LtiMbl  H(ni\H.'lL  ) 

AbK     r  b  1     f^btd 

i  rrhL    J 

InLL     ^r^:,l 

OtI       fMV.<^ll        Af^tL.cSiA 

IkLL    ^^i\:i'd 

bk.l  /mNJ,'i^  <<r%hL.,\H 
it  1  nb.NJ  (Sf<r  L  .  Lit-;M 
LIbl        1        lU      IMK.M'VI 

Kjr^    Ll^l 
UO 


orAbH      b 

PV      K.NJ'ML 

bKMbh     1 

Pu     ^r^  .•A,-iL 

1  rrtL 

IjOC.mL/ 

1 YPtL     d 

HOf%     bf.b 

uo 

dLHlMK 

f    I  I  ILL     &rK5l 

1  I  ILL     iol  I  ILL 

uLAiNJA 

1 rPLL    1 

bb.J     dP.Lil      [f      ^f<il 

Lu     ) 

inL,^ 

^d    oi-.O^    Ir     oriil 

Lu     1 

iHLN 

1     LL^sL    ^  Ol 


►  UK    «Ki>d    ar'.ui     jj    ar.u^ 

uo  •  ^  . 

If     in.ViMc:    L^     'NOi.t;'*     (j  J  i  J    .'^u.'^MM 

rcOV.     I.MUEvi     4     .b.  iKILL     6.-;,^>1ii     DEC    O     r(I  oH  1     5-     t-Jrx     Llil:      IOirCir.i2) 

iNj,\A,-i:     ujEaU 

rCU^.     I,>JUL.\1      1/1      ■      IjIAL'        JVc.nLl.\E     UC.U     i)    nib-ii     ^     rjn     Llil:      iJif-Cinil) 

oLAiNiK     id 

(\Jir.     5KIP    i-iEr'EAi     ,>jr%i\Ar    boLIist     *      ' 

nO^-     'GnA.'gu     lUi^L     '     nllj^i     S    r\j~    Llii:      IJ  1  AL  (  1  J  i  i- b  (  &ni  1  )  ) 

CSLA,\r<       ^ 

E.-^U 

UCL-     fOlhb    U::Ef\     fLi.\Lllu.\    kLmLu     <     CwLL     blvEv     >     ,vdA',E     iulF     JbJ     1 0  1  H 
Anb     1     nEALU     ur  1  r\     ALl-Mfi      '  ^r r '/ ^  ' 
Anb    i:    :3UdiCrtIH    oPiI'J\AL    vAf\Ti.\b 

fclNiU 

DCL    L/Ef'.NJii     Ubtn     I.\i^bt.^^     <     AbCI     >     vbuB     Ut.r'd 

uCL    UEr'.iVA.'^ii     U:5tri    CHmr     <    \Jt.rd     > 

UCL     PClCul     '_:3F.r^     aEAL     <     ACC  1      > 

L^    rErNCE.\l--.bE     Cli     APi^L  1  tu     iu     i-  T  7  D    kECJ^-'iENum  1  I  u.'J:> 

UCL     -IDtJDlO.H     !j>E/\     hEALu     <     MCui      > 

LiJ     MOLiE     dILL     i.^CLLUli^C     KLJJK     Af'.t..\U.'^  Ei\  1  i 

uCL    nEC/i.A     Uit-.     r\t.ALU     <     ACC  I      > 
Lj     iyV3    AEC'J.'it-.MJAi  I  j,\i     Ai     A,".Ei\Ut.U 

UCL     ;)E.\AiE     t-it.'N     r;tALlJ     <     MCCi      > 

LC     iE.MMlE     ifAtw     M,\U     -iLH.N^     CJiSUlEt.     r^  ECJ  1.1  t.i\uA  1  I  ij  vJi 

UCL     bt-.M.nJJ     Uiin.     r\-.'->L      <     .-*uul      > 
Lj     i  lam  in     r>tCi     -     -ijLj-jt     f\t.Ci 

UCL     iE.MMit.-!     ^itn    .■^E^LU     <     m(.C1      > 

Lu     iEi-^Ait.    MILL      li\CLUi;  li\i..    PLvJU.x     A.^lK.^U.It  .\  1  i 

UCL  HJu.bK.^.      LOK.'\     r^EAL     <     ACC  I      > 

bCL  iE.\.bt.,>J  uiEn.  nEAL  <  ACC  I  > 

UCL  HJu.L'E.v  uic..\  nt-AL  <  ACCl  > 

UCL  M.riWAi'     biEr<     itEAL     <     ^uC  1      > 

UCL  b.rilAA.r      Oit-fN     kEmL     <     HUCl      > 
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